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ABSTRACT 



This document discusses a project designed to assess trends 
in service data and the effectiveness of the services provided over a 10 -year 
period. It begins by describing the services provided by the Wilder 
Foundation Child Guidance Clinic, an outpatient mental health center serving 
children and families in the Saint Paul, Minnesota area. A number of trends 
emerged about the families served by the clinic. There was a notable increase 
in the percentage of families headed by single parents, and in the percentage 
experiencing chronic economic distress and frequent changes in residence. 
There were dramatic increases in the aggressive nature of clients, including 
the frequency of assaultive and threatening behaviors. An examination of 
service trends indicated a dramatic decline in the amount of services 
received by clients. The clinic staff attributed this decline to the growth 
of managed care, a decrease in the amount of group therapy provided by the 
clinic, and an increase in family mobility. A summary is provided of parental 
ratings of satisfaction with clinical services. The final topic concerns the 
challenges faced when designing and carrying out the evaluation of the Child 
Guidance Clinic and the difficulties encountered in reaching families for a 
follow-up. (Contains 15 references and 44 figures.) (JDM) 
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BRIEF PROJECT DESCRIPTION 

The purpose of this presentation was to describe the results of a project conducted by the 
Wilder Research Center. This project assessed trends in service data and effectiveness 
for clients served by the Wilder Foundation Child Guidance Clinic over a ten- year period 
(1988-1998). In 1999, our results were presented at the Child Welfare League of 
America’s National Conference on Research in Child Welfare. This report summarizes 
the presentation made at this conference. For more information about this project or a 
full report of project findings, please contact the Wilder Research Center. 



CONFERENCE PRESENTATION INTRODUCTION 




As seen in Figure 1, there were four goals for this presentation. The first goal was to 
describe the services provided by the Child Guidance Clinic and the way that these 
services are evaluated. Second, evaluation results for 1988-1998 were presented, with an 
emphasis on highlighting trends that have emerged related to the services that are 
provided, the population being served, and the effectiveness of the services. Third, an 
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overview of how these results have been used for program planning and improvement 
was provided. Fourth, lessons learned and challenges faced in implementing the 
evaluation and utilizing evaluation results were discussed. Figure 2 provides the outline 
for the presentation. 



Goals of the Session 



• Describe an evaluation of a community- 
based children’s mental health program. 

• Present applied research results and trends. 

• Discuss use of the results for program 
planning and improvement. 

• Share lessons learned and challenges faced. 



Outline of Session 



1. Introductions 

2. About the Wilder Research Center 

3. About the Child Guidance Clinic 

4. Population served by the clinic 

5. Evaluation design 

6. Evaluation results and trends 

7. Use of results and lessons learned 

8. Challenges 

9. Discussion 



1. Goals of the Session 



2. Outline of the Session 
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ABOUT THE WILDER FOUNDATION 



As an introduction to the conference presentation, general information was provided 
regarding the Amherst H. Wilder Foundation. The two divisions that conducted this 
project, the Wilder Research Center and the Child Guidance Clinic, were highlighted. 

The Amherst H. Wilder Foundation 

The Amherst H. Wilder Foundation is a large non-profit health and human service 
organization that operates a variety of programs serving the Saint Paul area. It provides a 
range of program efforts across the age span from early childhood to elderly. Services 
span all the way from community consultation to residential treatment centers. The 
foundation has 1,035 employees and an annual operating budget of $52.4 million. 

The Wilder Research Center 

Wilder Research Center is the research division of the Amherst H. Wilder Foundation. 
Figures 3 -5 provide an overview of the Wilder Research Center, including the types of 
services provided, clients served, and staff employed. 



3. Wilder Research Center: Research in Human Services 
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Wilder Research Center: Clients 




5. Wilder Research Center: Staff 





The Wilder Child Guidance Clinic 

Figures 6-9 provide introductory information about the Wilder Foundation Child 
Guidance Clinic, an outpatient mental health center serving children and families in Saint 
Paul, MN. This information includes an overview of the clinic’s service approach, efforts 
to provide accessible services, characteristics of the staff, and finances (i.e., funding 
sources). The clinic began in 1923 as a joint venture with the University of Minnesota. 

It was one of the original demonstration projects funded by the Commonwealth Fund to 
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study juvenile delinquency. This effort was interdisciplinary from the start. The clinic 
expanded from one social worker and one child psychiatrist to its current staff of 9.47 
FTEs. 



6 . 



Wilder Foundation Child Guidance Clinic: Service Approach 



Wilder Foundation Child Guidance Clinic 

Service A pproach 



* M ultip le com p etencies 

* Brief, intermittent therapy with 
^^wraparound” support 

* Measure outcomes and satisfaction 

* Collaborate with others 
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Wilder Foundation Child Guidance Clinic: Service Accessibility 



Wilder Foundation Child Guidance Clinic 



Accessibility 



• Child and family focus 

• Sliding fee 

• Services in home, school, and community 
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Wilder Foundation Child Guidance Clinic: Staff 



Wilder Foundation Child Guidance Clinic 

staff 



• Training and support 

• Different disciplines 

• Experienced 

• Flexible 



9. Wilder Foundation Child Guidance Clinic: Finances 
Wilder Foundation Child Guidance Clinic 

Finances 



• Client fees 

• Government contracts 

• Managed care contracts 

• Insurance 

• Wilder Foundation subsidy 
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POPULATION SERVED BY THE CLINIC 



Prior to the presentation of the evaluation design and results, an overview of the 
population served by the Child Guidance Clinic was presented. This overview 
summarized key demographic features of the population and highlighted several changes 
in the population that have emerged over the ten- year period. The clinic has served 800 
to 1200 clients per year over the past five years. Figure 10 summarizes the demographic 
features of the population served during the most recent program year included in the 
report (1998), including information about client gender, ethnicity, age, and poverty 
level. 



10. Wilder Foundation Child Guidance Clinic: Client Population, 1998 




Many of the demographic characteristics of this population have remained fairly 
consistent over the previous ten years. There were, however, changes over time in terms 
of client gender and ethnicity. These trends are depicted in Figures 1 1 and 12. As seen 
in Figure 1 1, for the first half of this ten- year period (approximately 1988-1993), the 
clinic served relatively equal numbers of male and female clients. However, over the 
most recent five years, the percentage of male clients has increased steadily. In 1998, 
sixty-nine percent of the clients were males, compared to fifty-three percent in 1988. 

-7- 
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Wilder Foundation Child Guidance Clinic: Trends in Client Gender, 1988-1998 




Figure 12 summarizes the trend related to client ethnicity. In 1988, the clinic served 
primarily white clients (87 percent). Over the following ten-year period, there was a 
steady decrease in the percentage of the population that was white and an increase in the 
percentage of clients representing other races. In 1998, clients of other races made up 
thirty-five percent of the population served by the Child Guidance Clinic. 

12. Wilder Foundation Child Guidance Clinic: Trends in Client Ethnicity, 1988-1998 

Wilder Foundation Child Guidance Clinic 

Trends in Client Ethnicity, 1988 - 1998 




White 

clients 



All other 
races 
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Figures 13-16 summarize key characteristics of the families and children served by the 
Child Guidance Clinic. These data were collected using the Wilder Foundation Client 
Characteristics Checklist, an instrument developed by the Wilder Research Center to 
document a variety of potential risk factors and descriptive characteristics of individuals 
and families served by Foundation programs. 

A number of trends emerged between 1988 and 1998 related to the families served by the 
Clinic. As seen in Figure 13, there was a notable increase in the percentage of the 
families headed by single parents. The percentages experiencing chronic economic 
distress and frequent changes in residence also increased. Other common features of the 
families included frequent conflicts between parents and children, chronic conflicts 
between parents, and histories of parental chemical abuse (see Figure 14). 



13. Wilder Foundation Child Guidance Clinic: Changes in Family Situations 



Wilder Foundation Child Guidance Clinic 

Change in Family Situation 



100 % 



67 % 




1988 1998 1988 1998 1988 1998 

Single parent Chronic economic Frequent changes 
family distress In residence 
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Wilder Foundation Child Guidance Clinic: Common Family Characteristics, 1998 



Wilder Foundation Child Guidance Clinic 

Common Family Characteristics, 1998 



* Frequent conflicts between parent and child 
(75%) 

• Chronic conflicts between parents (55%) 

• History of parental chemical abuse (47%) 

* At least one previous outpatient intervention 
for child (46%) 

• Previous parental involvement with social 
service agencies (34%) 

* Previous mental illness outpatient treatment of 
parent (33%) 



Between 1988 and 1998, there were also a number of changes seen in the types of 
behaviors and characteristics exhibited by the children who received services from the 
clinic. Most notably, there were dramatic increases in the aggressive nature of the 
clients, including the frequency of assaultive behaviors and threatening or intimidating 
others (see Figure 15). Other common characteristics of the children served by the clinic 
included impulsivity, isolative or withdrawn behavior, and receipt of special education 
services (see Figure 16). 
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Wilder Foundation Child Guidance Clinic: Trends in Child Behavior, 1988-1998 



Wilder Foundation Child Guidance Clinic 

Trends in Child Behavior, 1988 - 1998 



1 00 % 



50 % 



45 % 




1988 1998 

Assaultive 



44 % 




1988 1998 



Threatens or 
intimidates others 



16. Wilder Foundation Child Guidance Clinic: Common Child Characteristics, 1998 




A wide variety of diagnostic categories are represented among Clinic clients. The most 
common diagnoses are detailed in Figure 17. These diagnoses include attention deficit 
disorder, several oppositional and conduct disorders, anxiety disorders, dysthymia, and 
problems associated with the parent-child relationship. 
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Wilder Foundation Child Guidance Clinic: Most Common Diagnoses, 1988*1998 



Wilder Foundation Child Guidance Clinic 



Most Common Diagnoses, 1988 - 1998 



• Attention deficit disorder 

• Oppositional disorder 

• Dysthymic disorder 

• Anxiety state - unspecified 

• Generalized anxiety disorder 

• Parent-child problems 
•p Conduct disorder 



EVALUATION DESIGN 

As seen in Figure 18, the evaluation of the Child Guidance Clinic conducted by the 
Wilder Research Center is designed to address two program goals. The first goal of the 
program is for clients to demonstrate increased positive adjustment. This goal is 
measured using the Achenbach Child Behavior Checklist (CBCL). As detailed in Figure 
19, this Checklist is completed by parents at the time of a child’s intake into the program 
and six months later for a random sample of clinic clients (25 perceiit of clinic clients). 

The second goal is for parents to indicate satisfaction with clinic services. This goal is 
measured using a telephone survey of a sample of parents conducted by Wilder Research 
staff six months following a child’s intake into the program. Approximately two-thirds of 
the clients are no longer receiving treatment six months after intake. 
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Wilder Foundation Child Guidance Clinic: Service Effectiveness Goals 



Wilder Foundation Child Guidance Clinic 

Service Effectiveness Goals 



• Clients will demonstrate increased positive 
adjustment. 

• Parents will indicate satisfaction with clinic 
services. 



19. Wilder Foundation Child Guidance Clinic: Overview of Evaluation Design 



wilder Foundation Child Guidance Clinic 

Overview of Evaluation Design 



Evaluation sample - 25 % of eligible clients 

(minimum of 12 clients per month) 

Evaluation components: 

* Child Behavior Checklist completed by 
parents at intake and six months later 

* Program Evaluation Questionnaire 
completed by parents six months after 
intake (telephone survey) 
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Figures 20 - 22 summarize key features of the Child Behavior Checklist and the specific 
indicators of success used for the Child Guidance Clinic evaluation. The Child Behavior 

Checklist provides scores in eight symptom areas. The scores in each of these areas are 
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